Finding People by Contingency: An Infomax Controller Approach

نویسنده

  • Javier R. Movellan
چکیده

We frame social interaction as a problem in real-time system's identification and control. System's identification refers to the task of identifying the properties of a system we are trying to control. Control refers to the problem of sending an input sequence to a system in order to maximize expected returns with respect to desired goals. The brain faces a control problem when sending motor commands to the limbs, where it has to account for the inertial properties of the arm and the delays and levels of uncertainty in the efferent and afferent transmission lines. Riding a bicycle, shooting baskets, and playing a musical instrument are also control problems. Social interaction can be approached from the point of view of stochastic control theory under conditions of random delays and uncertainty much larger than those found when controlling non-social instruments. We illustrate this framework on the problem of finding people via contingency. There is strong evidence that infants use contingency analysis to identify other humans (Watson 1972, 1979) and that in fact contingency information may be more powerful than morphological properties of human faces (like the presence of eyes). Indeed we found that by ten moths of age infants used contingency information in a very active manner, ascertaining in a matter of seconds, whether a robot was or was not responsive to them (Movellan and Watson, 1987, 2002). We formalize the control problem in terms of a generative model in which observed behaviors can be produced by three different causes: (1) Self feedback (e.g., when we hear our own vocalization). (2) Responses from other humans that are related to our activity. (3) Background reponses unrelated to our activities. There are two possible control conditions: (1) A human is responding to us; and (2) Human are not responding to us. Given the random delays and noise typical of social interaction, the goal of the controller is to generate a sequence of behaviors that gather as much information as possible in a minimum amount of time about which of the two conditions we are operating under. We call this an infomax controller. Interestingly the controller exhibits patterns of behavior very similar to those found in 10 month infants when interacting with a robot system for the first time. The controller is currently being implemented on RUBI, a social robot under development at our laboratory, and will be ready for demonstration at ICDL2004.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Detecting contingencies: An infomax approach

The ability to detect social contingencies plays an important role in the social and emotional development of infants. Analyzing this problem from a computational perspective may provide important clues for understanding social development, as well as for the synthesis of social behavior in robots. In this paper, we show that the turn-taking behaviors observed in infants during contingency dete...

متن کامل

Active inference in concept induction

People are active information gatherers, constantly experimenting and seeking information relevant to their goals. A reasonable approach to active information gathering is to ask questions and conduct experiments that maximize the expected information gain, given current beliefs (Lindley, 1956; Good, 1966; MacKay, 1992). In this paper we compare the behavior of human subjects with that of an op...

متن کامل

تبیین الگوی اقتضایی کنترل

One of the major duties of managers in managing their organizations is to explain appropriate approaches and models of control. Since the common models in organizations are based on a traditional approach and closed system, in this research, an attempt has been made to present a contingency approach of control on the basis of the contingency approach which underlines the effects of contextual v...

متن کامل

Intelligent Auto pilot Design for a Nonlinear Model of an Autonomous Helicopter by Adaptive Emotional Approach

There is a growing interest in the modeling and control of model helicopters using nonlinear dynamic models and nonlinear control. Application of a new intelligent control approach called Brain Emotional Learning Based Intelligent Controller (BELBIC) to design autopilot for an autonomous helicopter is addressed in this paper. This controller is applied to a nonlinear model of a helicopter. This...

متن کامل

InfoMax Control for Acoustic Exploration of Objects by a Mobile Robot

Recently, information gain has been proposed as a candidate intrinsic motivation for lifelong learning agents that may not always have a specific task. In the InfoMax control framework, reinforcement learning is used to find a control policy for a POMDP in which movement and sensing actions are selected to reduce Shannon entropy as quickly as possible. In this study, we implement InfoMax contro...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2004